Connected to Snowflake.
Customer: KIVA
Schema: KIVA_PROD.OPTIML
2023-02-26 2023-03-04

Total cost breakdown¶

Cost by usage category¶

Category: Credit and dollar consumption trends
----------------------------------------------
category_name      credits_previous_week    dollars_previous_week    credits    dollars    pct_change_dollars
---------------  -----------------------  -----------------------  ---------  ---------  --------------------
Cloud services                     33.75                    67.5       33.39      66.78                 -1.07
Compute                           595.47                  1190.95     612.94    1225.89                  2.93
Storage                             0                       53.81       0         51.63                 -4.05
Total                             629.22                  1312.25     646.33    1344.3                   2.44

Cost by user¶

Users: Credit consumption trends
--------------------------------
user_name                  approximate_credits_previous_week    approximate_credits    pct_change_credits
-----------------------  -----------------------------------  ---------------------  --------------------
AMPLITUDE                                               0.02                   0.02                  0
ANALYTICS_EXERCISE_USER                                 0.52                   0.06                -88.46
DBT_DEV                                                46.89                  54.64                 16.53
DBT_PROD                                               95.85                  99.32                  3.62
FIVETRAN_USER                                         263.97                 264.33                  0.14
FIVETRAN_USER_DEV                                      39.94                  35.68                -10.67
GREGORYW                                                0.54                   0.48                -11.11
GREGORYW_DEV                                            2.21                   2.88                 30.32
HUGOV_DEV                                               0.01                   0.05                400
LOOKER_DEV_ADMIN                                        2.26                   2.26                  0
LOOKER_PROD                                            22.5                   27.91                 24.04
LOOKER_PROD_ADMIN                                      10.46                  11.38                  8.8
LOOKER_RAW_DEV                                          0.31                   0.3                  -3.23
LOOKER_RAW_PROD                                         3.4                    2.91                -14.41
ML_SERVICE_DEV                                         53.6                   57.47                  7.22
ML_SERVICE_PROD                                        38.94                  48.36                 24.19
OPTIML                                                  0.39                   0.71                 82.05
PATRICKL_DEV                                            0.72                   0                  -100
ROBS                                                    0.07                   0.48                585.71
VERTEX_API_DEV                                          1.49                   1.29                -13.42
VERTEX_API_DEV_JENKINS                                  0.41                   0.36                -12.2
VERTEX_API_PROD                                        44.69                  35.43                -20.72
MAXH_DEV                                                0                      0                   nan
Total                                                 629.19                 646.32                  2.72
List of low usage users (<1% of credits) with usage (Current month)
-------------------------------------------------------------------
user_name                  approximate_credits    percent_usage
-----------------------  ---------------------  ---------------
AMPLITUDE                                 0.02            0.003
ANALYTICS_EXERCISE_USER                   0.06            0.009
GREGORYW                                  0.48            0.074
GREGORYW_DEV                              2.88            0.446
HUGOV_DEV                                 0.05            0.008
LOOKER_DEV_ADMIN                          2.26            0.35
LOOKER_RAW_DEV                            0.3             0.046
LOOKER_RAW_PROD                           2.91            0.45
OPTIML                                    0.71            0.11
PATRICKL_DEV                              0               0
ROBS                                      0.48            0.074
VERTEX_API_DEV                            1.29            0.2
VERTEX_API_DEV_JENKINS                    0.36            0.056
MAXH_DEV                                  0               0

Cost by warehouse¶

Warehouses: Credit consumption trends
-------------------------------------
warehouse_name         credits_previous_week    credits    pct_change_credits
-------------------  -----------------------  ---------  --------------------
CLOUD_SERVICES_ONLY                     0          0                     0
DEV_WH                                148.96     155.83                  4.61
ML_WH                                  33.06      42.66                 29.04
PROD_AUX_WH                            52.55      54.31                  3.35
PROD_WH                               394.64     393.53                 -0.28
Total                                 646.33     629.21                 -2.65

Cost by partner tools¶

Client Application: Credit consumption trends
---------------------------------------------
client_application_name      approximate_credits_previous_week    approximate_credits    pct_change_credits
-------------------------  -----------------------------------  ---------------------  --------------------
Go                                                        0.57                   0.54                 -5.26
JDBC                                                    342.95                 345.27                  0.68
ODBC                                                     46.59                  37.08                -20.41
Python                                                  238.59                 263.38                 10.39
Snowflake UI                                              0.52                   0.06                -88.46
Total                                                   629.22                 646.33                  2.72

Resource monitoring¶

Generate Resource Monitors for the dataware house based on data from this week¶

Query templates for you to generate resource monitor for this week

USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR DEV_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=25.25
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE DEV_WH SET RESOURCE_MONITOR=DEV_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR ML_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=5.8
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE ML_WH SET RESOURCE_MONITOR=ML_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR PROD_AUX_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=9.3
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE PROD_AUX_WH SET RESOURCE_MONITOR=PROD_AUX_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR PROD_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=62.57
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE PROD_WH SET RESOURCE_MONITOR=PROD_WH_RESOURCE_MONITOR;

Runbook¶

  • If the resource monitor did not send a notification last week and the new resource monitor proposed is within 10% of previous monitor - dont update the resource monitor

  • If the resource monitor sent a notification last week due to an unexplained usage that cannot be attributed to legitimate use continue to debug and dont change the resource monitor

  • If the resource monitor sent a notification last week that can be attributed to legitimate use update the resource monitor

  • If the new resource monitor values are >10% over last week's values update the resource monitor